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CORRECTING MOTION VECTOR MAPS FOR IMAGE PROCESSING 

BACKGROUND 

There are many ways in which motion may be estimated between two images. 
5 This motion may be described by a set of motion parameters that describe motion of 
luminance of pixels from a first image to a second image. These motion parameters may 
be defined at a time associated with either or both of the first and second images, or may 
be defined at a time between the first and second images. Thus, a vector for each pixel 
describes the motion of the pixel from one image to the next. 
10 This motion estimate may be computed by using a gradient-based method, of 

which an example is a technique referred to as computing the "optical flow" between the 
CI images, or by using a correlation-based method. The "constant brightness constraint," the 

assumption underlying the computation of optical flow, may be violated because of a 
change in an object's position relative to light sources, an objects specularity, an overall 
fl| 15 luminance change, a lack of similarity between the input images, an object entering or 
fs\ leaving a scene, or an object becoming revealed or occluded. If a violation of the 

= c . constant brightness constraint occurs, the motion vectors from one coherent area of 

s p motion may spread into another coherent area of motion. 

IX If erroneous motion information is used to perform various image processing 

□ 20 operations, such as morphing, warping, interpolation, motion effects, and motion 

blurring, visible artifacts are seen in the resulting output images. For example, in some 
cases, the foreground may appear to stretch or distort, or the background may appear to 
stretch or distort, or both. 



25 SUMMARY 

Visible artifacts in images created using image processing based on motion 
vector maps may be reduced by providing one or more mechanisms for correcting the 
vector map. In general, the set of motion vectors is changed by selecting one or more 
portions of the image. The vectors corresponding to the selected one or more portions 

30 are modified. Various image processing operations, such as motion compensated 
interpolation, may be performed using the changed set of motion vectors. Various 
mechanisms for obtaining a changed set of motion vectors may be used separately or 
combination by a user. 
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In one method, a region in an image may be defined. The region may be 
segmented into foreground and background regions. A tracker then may be used to track 
either the foreground region or the background region or both. A single motion vector or 
a parameterized motion model obtained from the tracker may be assigned to the tracked 
5 region. 

In another method, a combination map may be defined to control which pixels of 
the input images are used to contribute to each pixel of an output image based on how a 
motion vector transforms a pixel from the input image to the output image. The 
combination map is used with a specified region to which one or more motion vectors 
10 are assigned. Such combination maps may be used in combination with the tracker 
described above. 

In another method, a color image is generated using the motion vectors. The 
color image then may be modified using conventional color modification tools. The 
modified color image then may be converted back to motion vectors. 
15 In another method, a user-specified transform between the two images may be 

used to define a set of vectors that correspond in time and resolution to the motion 
vectors estimated between the two images. The set of vectors may be combined with the 
estimated motion vectors to produce a set of vectors used for image processing 
operations. 

20 Accordingly, in one aspect, motion vectors are generated by determining a set of 

motion vectors that describes motion between the first and second images. The set of 
motion vectors is changed by selecting one or more regions in the image and modifying 
the vectors corresponding to the selected one or more regions. Image processing 
operations may be performed on the images using the changed set of motion vectors. 

25 The set of motion vectors may be changed by identifying a foreground region and 

a background region in the first and second images. Tracking is performed on at least 
one of the foreground region and the background region to determine a motion model for 
the tracked region. The set of motion vectors corresponding to the tracked region is 
changed according to the motion model for the tracked region. 

30 The motion vectors may be changed by identifying a foreground region and a 

background region in the first and second images. A combination map is defined to limit 
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how the vector map is applied to transform a pixel from the input image to the output 
image. 

The set of motion vectors may be changed by receiving an indication of a user 
specified transform between the first and second images. Vectors are computed using 

5 the user specified transform and corresponding in time and in resolution with the motion 
vectors defined by motion estimation. The computed vectors are combined with the set 
of motion vectors. In one embodiment, the user specified transform may be defined by 
at least one point in a first image and at least one corresponding point in the second 
image. A transform for warping the first image to the second image that maintains 

10 correspondence between the at least one point in the first image and the at least one point 
in the second image may be determined. The vectors are computed by determining, for 
each pixel, a set of transform vectors that describe the spatial transform of the region of 
the first image to the corresponding region in the second image. The user specified 
transform also may be defined by at least one line, and/or by at least one region. 

15 The set of motion vectors may be changed by displaying to the user a color image 

defined by the set of motion vectors. The user is allowed to modify the color image 
defined by the set of motion vectors. The set of motion vectors is then changed 
according to the modified color image. 



20 BRIEF DESCRIPTION OF THE DRAWINGS 

Figs. 1 A-B illustrate segmentation of an image region for modifying the set of 

motion vectors and creating a combination map. 

Fig. 2A is a flowchart describing an approach for correcting a first kind of 

artifact. 

25 Fig. 2B is a flowchart describing an approach for correcting a second kind of 

artifact. 

Fig. 2C is a flowchart describing an approach for correcting a third kind of 

artifact. 

Fig. 3 is a dataflow diagram illustrating an example of encoding motion vectors 
30 into a color image for editing. 

Fig. 4 is an illustration of an example legend mapping vectors to colors. 

Fig. 5 illustrates how motion vectors may be computed from a spatial transform. 
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Fig. 6 is a dataflow diagram illustrating and example system that combines 
vectors of user-specified transforms with motion vectors. 

Fig. 7 illustrates example images processed using a system such as shown in Fig. 

6. 

5 Fig. 8 is a dataflow diagram illustrating the use of user-specified transform for 

preprocessing images. 

DETAILED DESCRIPTION 
There are several techniques that may be used to reduce visible artifacts in 

10 images processed using motion estimates. In general, the vector map that estimates the 
motion between images may be corrected to change the motion vectors that are causing 
the artifacts. In particular, one or more regions in the image may be selected. The 
vectors corresponding to the selected one or more regions are modified. Various image 
processing functions then may be performed using the changed set of motion vectors. 

15 A first example technique involves identifying foreground and background 

regions, and applying the motion vectors differently depending on how they relate to the 
foreground and background in the two images. This technique is described below in 
connection with Fig. 1 A to Fig. 2C. A second example technique involves displaying the 
vector map as a color image, which can be modified using conventional color 

20 manipulation tools or by applying morphological operations to the color image. The 
modified color image is converted back into a vector map. This technique is described 
below in connection with Figs. 3-4. A third example technique involves using image 
warping technology to generate vectors of user defined motion to replace derived motion 
vectors. Alternatively, image warping may be used to preprocess images before motion 

25 vectors are derived. This technique is described below in connection with Figs. 5-8. 

Referring now to Fig. 1 A, a region of an image that contains an artifact is 
segmented. The image region is segmented into two coherently moving areas: a 
foreground region (FG1 and FG2) and a background region (BG). This segmentation is 
performed on each input image of each pair of input images for which the output image 

30 exhibits a visible artifact. Identification of a region and this segmentation may be 

performed automatically, for example using a luma key or a chroma key, or may use a 
predetermined matte, or may be performed by a user through an appropriate graphical 



user interface, such as a tracing tool that is used by the user to trace a foreground object. 
A new set of motion vectors is generated using the defined segmentation. A 
"combination map" also may be generated, as described below in connection with Fig. 
IB in one embodiment, to control how the input images are combined using the new set 
5 of motion vectors. 

The following are three approaches for fixing the set of motion vectors using the 
segmented regions of the image. The particular approach used to remove an artifact may 
be selected by providing a mechanism through a user interface through which the user 
may indicate the kind of artifact that is present in the image. 

10 The first approach, as shown in the flow chart of FIG. 2A, is used when the 

background segment shows artifacts, but the foreground segment does not. In this case, 
the original motion vectors may be used to describe the foreground motion, but not the 
background motion. After specification of an image region (step 200) and segmentation 
of the image region (step 202), a motion vector for each pixel in the background area 

15 may be determined by running a tracker on the specified background area (step 204).This 
background area is exclusive of a region (110 in Fig. 1A) that includes both of the 
foreground regions FG1 and FG2 of the first and second images. 

Any suitable tracker, such as those used for stabilization and object tracking 
applications may be used. The result of the tracker is a parameterized motion model 

20 describing the motion of the region that is tracked. The parameterized motion model 
may be a single motion vector, which describes translational motion, or an affine motion 
model defined by six parameters, or a projective motion model defined by eight 
parameters. A motion model is used to generate a new set of per pixel motion vectors. 
Each pixel in the entire background region, excluding region 1 10, is then 

25 assigned a motion vector according to the parameterized motion model provided by the 
tracker (step 206). Next, for each pixel in the bounding box 1 10, it is then determined 
whether the original motion vector for the pixel, or the new motion vector for the 
background is to be used. As shown in FIG. 1 A, for each pixel in the bounding box 410 
that incorporates foreground FG1 and foreground FG2, if an original motion vector 

30 would move the pixel from the foreground region FG1 in the first image to the 

foreground region FG2 in the second image (step 210) then the original motion vector is 



used (step 212). Otherwise, the newly determined motion vector for the background is 
assigned to that pixel (step 214). 

Given the modified set of motion vectors, a "combination map," such as shown in 
Fig. IB, may be created (step 216). The combination map may be used to control how 
5 pixels from the background and foreground are combined using the new set of motion 
vectors. In particular, if a pixel in the bounding box 110 (Fig. 1A), and outside of the 
foreground FG1 of the first input image is transformed by a motion vector to the 
foreground region FG2 of the second input image, then only the first input image is used 
to generate the output image using this motion vector. Similarly, if a pixel in the 

10 foreground region FG1 (Fig. 1 A) of the first input image is transformed by a motion 
vector to the region outside of the foreground FG2 of the second input image, then only 
the second input image is used to generate the output image using this motion vector. 
Thus, each motion vector may be assigned a value, for example by creating a new two- 
dimensional image, called a "combination map," which has values of 0, 1, or 2. A value 

15 of 0 indicates to combine both frames A and B, as indicated at 120. A value of 1 

indicates that only frame A contributes to the output when warping, as indicated at 124, 
and a value of 2 indicates that only frame B contributes to the output, as indicated at 122. 
The combination map may be processed, for example by a filter, to fill any holes or to 
account for incorrectly segmented input regions. 

20 In a second approach, shown in FIG. 2B, the foreground segment exhibits 

artifacts, but the background segment does not. In this case, the original motion vectors 
may be used to describe the background motion, but not the foreground motion. Thus, 
after segmenting an area into foreground and background regions (step 230), the 
background image region is cleared (step 232). A tracker is run on the foreground region 

25 (step 234) and to obtain a parameterized motion model. This motion model is used to 
determine, for each pixel in the region, a motion vector. Next, for each pixel in the 
bounding box 1 10, it is determined whether the new motion estimate transforms a pixel 
in the foreground FG1 of the first image to a pixel in the foreground FG2 of the second 
image (step 238). If it does, then the new motion vector obtained from the result of the 

30 tracker is used (step 240). If not, then the original motion vector is used (step 242). A 
combination map then may be created (step 244) to decide from which input images 
pixels are taken in the warping operation. 
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In a third approach, as shown in the flow chart of FIG. 2C, both the foreground 
and background regions exhibit artifacts. After segmentation of the region (step 250), a 
tracker is run on the foreground region (step 252) to obtain a parameterized motion 
model. A tracker is run on the background region (step 256) to obtain another 
5 parameterized motion model. Each pixel in the background BG and foreground FG is 
assigned a motion vector according to the results from the tracker (step 258). Pixels in 
the bounding box 1 10 are assigned a motion vector from the foreground tracker or from 
the background tracker according to whether the motion vector from the foreground 
tracker transforms the pixel from foreground FG1 to foreground FG2 (step 259). A 

10 combination map then may be created (step 260). 

It should be understood that the combination map as described above may be 
used with motion vectors assigned through another process to a region, without using a 
tracker. Given an identified region, the combination map limits how the vector map is 
applied to the identified region to transform a pixel from the input image to the output 

15 image. 

Another technique for changing motion vector maps uses a user interface to 
display a representation of the motion vectors to allow a user to correct one or more 
individual motion vectors. In particular, the motion vectors may be encoded as a color 
image that is displayed to the user. The results of changes to the motion vectors may be 

20 shown interactively by updating the output image generated by processing the two input 
images using the updated motion vectors. A number of options may be presented to the 
user to change the set of motion vectors. For instance, a user may be permitted to define 
a region of vectors. The user may provide a single value for the whole region, or a 
separate value for each of several individual pixels in the region. Alternatively, a single 

25 value could be assigned automatically to the region, for example by computing an 
average value of a different region of vectors, or other values may be assigned 
automatically. As another example, a planar perspective model could be applied to a 
planar patch to generate vectors. 

Referring to Fig. 3, and example system providing such a user interface will now 

30 be described. Two input images 300, 302 are processed using motion estimation 304 to 
provide a vector map (not shown). The vector map is processed by a vector color 
encoder 306 to provide color encoded image 308. Details of an example vector color 
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encoder are provided below. The color encoded image 308 is displayed to the user, and 
the user is permitted to manipulate the image using color manipulation tools or by 
applying morphological operations to the image, as indicated at 310. Such color 
manipulation tools may include conventional paint and color correction tools, or other 
5 tools that allow a user to match different color regions, or change the chrominance. A 
linear operator, such as a blur filter, may be used. Morphological operators such as 
erode or dilate or hole fill, or a median filter, also may be used. The modified image is 
then processed by an inverse vector color encoder 312 to provide a changed set of 
motion vectors 314. Details of an example inverse vector color encoder are provided 
10 below. 

In one embodiment, the vector color encoder maps the magnitude of each vector 
to a luma component and the direction to the chroma component. Given the motion 
estimate in the x and y directions for a pixel as a vector having magnitude u and direction 
v, the following equations may be used to compute a corresponding luma value (e.g., Y) 
15 and chroma values (e.g., U, V): 

Y = sqrt (u*u + v*v); 
theta = -atan2(v,u); 

U = f(u,v)*cos(theta); and 

V = f(u,v)*sin(theta). 

20 If saturation is constant the f(u,v) = 0.5. If saturation is not constant, f(u,v) may 

be, for example, defined by the following formula: 

max ~ |v|min) 

where |v| is the magnitude of a vector, |v|niin is the minimum magnitude from 
among the vectors, and Iv)^ is the maximum magnitude from among the vectors. With 
25 these values calculated for the motion vector for each pixel, a color image is generated. 

It should be understood that the color encoder may convert the motion vectors 
into values into any color space, including but not limited to RGB, HSL, HSV, YUV, 
YIQ and CMYK. 

The inverse operations may be performed to take a color image and create a 
30 vector map. Formulas describing these inverse operation are: 
theta = acos(U/f(u,v)); 
u = Y*cos(theta); and 



v = Y*sin(theta). 

In another embodiment, the color image representing the motion vectors may use 
the luminance of an image as its luma, with the Cr and Cb values computed in the 
manner described above. The image may be one of the input images, a blend of the input 
5 images, a blend of the input images warped using the motion vectors, or one of the input 
images warped using the motion vectors. 

In any conversion of the motion vectors to a color, the range of the vectors that 
are converted into color also may be limited, by defining a minimum and maximum 
value for the vector magnitude. In this embodiment, the luma component of a pixel in 

10 the color image representing the motion vectors is the luminance of the original image. 
Instead of using the value 0.5 as a coefficient in the equations above, the coefficient is 
computed as a percentage within the range of values between the minimum and 
maximum values. For example, if the magnitude of the vector is outside of the range of 
values between the minimum and maximum values, the chroma components may be zero 

15 (indicating zero saturation), or one (indicating maximum saturation), or may be clipped 
to the minimum or maximum value. If the magnitude of the vector is inside the range of 
values between the minimum and maximum values, the coefficient is defined by the 
fraction of the difference between the magnitude and the minimum value over the 
difference between the maximum and the minimum value. A user interface may be 

20 provided to allow a user to adjust the minimum and maximum values. 

To allow a user to understand the color image and how it conveys information 
about the motion vectors that it represents, a color legend, such as illustrated by Fig. 4, 
may be used. In Fig. 4, a vector (e.g., 402) having a magnitude and direction is 
illustrated as an arrow, having its origin 400 at a pixel having a color representing the 

25 magnitude and direction. Several pixels in the color legend along a grid are so 

represented. The arrangement of the colors is generated by representing the vector 
magnitude on the y-axis, and the vector direction (e.g., angle) on the x-axis. The color 
corresponding to each point is then displayed. A legend also may be provided by a 
color wheel that is displayed adjacent to the color image representing the motion vectors. 

30 As a user controls a cursor control device (e.g., a mouse) to move a pointer on a screen 
over the color image, the vector corresponding to the pixel may be visualized in the color 
wheel as a point in the color space. This point to which a vector is mapped is at a radius 
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from the center of the color wheel that corresponds to the vector magnitude and is at an 
angle that corresponds to the vector direction. Thus a more saturated color represents a 
longer vector and thus would appear to be closer to the edge of the color wheel. The 
direction of the vector corresponds to the color to which it is pointing, i.e., the hue angle. 
5 Thus, the orientation of the color wheel matches the orientation of the motion vectors 
with respect to the images being viewed. For example, if red is shown in the color wheel 
in the upper left, then motion up and to the left at a pixel will cause that pixel to be 
displayed in the color red, and the greater the magnitude of the motion, the greater the 
saturation. The minimum and maximum values for the saturation also may be used to 

10 control the display of a point on the legend. 

Various visual effects also may be provided by the color image generated from 
the vector maps. For example, the color image that is created may be blended with the 
luminance of the original image. The color in the blended image highlights 
characteristics of motion may in the original image. For some image sequences, the 

15 color image created from the vector maps may be stored as a clip. This conversion of the 
motion information into an image may provide an interesting visual artistic effect. These 
effects also may be viewed by a user to provide another way of visualizing the motion 
information that has been estimated for the images. 

Another way to correct artifacts using motion vectors involves using spatial 

20 warping and morphing techniques. Such techniques involve defining a mesh on an 
image, transforming the mesh, and generating an image using the transformed mesh to 
sample the original image. The mesh is defined by basic shapes called facets, which may 
be a polygon, such as a quadrilateral a triangle. The transform of the mesh may be 
specified manually. A mesh also may be specified by creating a mesh around points, 

25 lines and shapes. A user may specify start and destination positions of these points, lines 
and shapes. The transform of the mesh is derived from the specified mesh, and the 
specified start and destination positions of points, lines, curves and shapes that are used 
to define the mesh. The transform is used to warp two images (representing the start and 
the destination) towards each other, which are then blended together to produce an 

30 output image. Such techniques are described, for example, in Digital Image Warping, 
by George Wolberg, IEEE Computer Society Press, 1990, and "Smooth interpolation to 
scattered data by bivariate piecewise polynomials of odd degree," by R.H.J. Gmelig 
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Meyling et al., Computer Aided Geometric Design, Vol. 7, pages 439-458, 1990, and 
"Piecewise Cubic Mapping Functions for Image Registration," by A. Goshtasby, Pattern 
Recognition, Vol. 20, No. 5, pp. 525-533, 1987, and "A method of bivariate interpolation 
and smooth surface fitting for irregularly distributed data points," by H. Akima, ACM 
5 Transactions on Mathematical Software, Vol. 4, No. 2, June 1978, pp. 148-159, and "A 
triangle-based C 1 interpolation method," by R.J. Renka et al., Rocky Mountain Journal of 
Mathematics, Vol. 14, No. 1, 1984, pp. 223-237, and "Approximation and geometric 
modeling with simplex B-splines associated with irregular triangles," by S. Auerbach et 
al., Computer Aided Geometric Design, Vol. 8, pp. 67-87, 1991, and "A piecewise linear 
10 mapping function for image registration," by A. Goshtasby, Pattern Recognition, Vol. 19, 
pp. 459-466, 1986. 

The transforms that are derived for mesh warping and morphing can be used to 
generate a set of motion vectors that describe the transform. For example, referring now 
to Fig. 5, during a warp operation, a point in time along the path between the start and 

15 destination positions is specified for each vertex of each facet of the mesh. This 

specified point in time corresponds to the point in time at which the motion vectors are 
centered using motion estimation. 

Typically the motion vectors are centered on one of the images or may be 
centered at the midpoint or other location between the images. For example, as 

20 described in U.S. patent application serial number 09/657,699 filed September 8, 2000, 
and hereby incorporated by reference, this point may be the midpoint between the two 
images, as indicated in Fig. 5. See also U.S. patent application entitled " Analyzing 
Motion of Characteristics in Images," by Katherine Cornog and Randy Fayan, filed on 
even date herewith and U.S. patent application entitled "Interpolation of a Sequence of 

25 Images Using Motion Analysis," by Katherine Cornog et al., filed on even date herewith, 
both of which are hereby incorporated by reference. 

In the following example, the motion vectors are centered at the midpoint 
between two images. Using the transform specified by the mesh for the warping 
operation, given a point (x,y) in the output image, a location (xl, yl) in the source image 

30 that is resampled to generate that image is determined. The motion vector (u,v) for point 
(x,y) is computed as twice the difference between the pixel location (x,y) and the pixel 
location (xl,yl). In particular, u=2*(x-xl) and v=2*(y-yl). The difference in locations 
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is doubled because the motion vectors represent motion between the two images and they 
are centered at the midpoint between these images. Thus, as indicated in Fig. 5, if the 
vertical distance between a pixel location in the vector map and a pixel location in the 
source image is 1.3, then the distance between the pixel location in the destination image 
5 and the pixel location in the source image is 2.6. The sign of the vector depends on the 
orientation of the image space, which in this case is the upper left corner of the image. 
Hence the vertical vector map includes the value -2.6 for the example pixel. 

Using this technique, any user specified spatial transform may be used to 
generate vectors that correspond to the vector map generated using motion estimation. 

10 Referring now to Fig. 6, the vectors generated for a user specified transform and 

those generated from motion estimation may be combined and used for various image 
processing applications that use motion vectors, such as warping. As shown in Fig. 6, 
the input images 600 are processed by motion estimation 602 to produce a set of motion 
vectors 604. The input images 600 also are provided to a user interface 606 through 

15 which a user may specify points, lines, curves and/or regions in one of the images, and 
corresponding points, lines or shapes in the other of the images, indicated as 
correspondences 608. A user also may specify a bounding box, or region of influence 
610. If this region does not move between the two images, this region limits the extent 
of any operations on the input images by the warp engine 612. The warp engine 612 

20 implements a conventional warping operation, with the modification noted above that 
causes it to output vectors 614 for each pixel in a grid at a point in time that corresponds 
to the point in time used to specify the motion vectors 604. The motion vectors 604 and 
614 are combined at 616 to produce a changed set of vectors. The combination may be a 
blend of both sets of vectors, or a replacement of some of the motion vectors 604 by 

25 motion vectors 614, for example, within a specified region, e.g., the region of influence. 
The sets of vectors may be combined using an alpha matte, which may be specified by 
the user, derived from the region of influence or specified in any other way. The 
changed motion vectors then may be used for further image processing, for example a 
warp operation 618. The result 620 of such processing also may be provided to the user 

30 interface 606 to allow a user to interactively modify the correspondences 608 and region 
of influence 610 based on the results. The combined motion vectors, or motion vectors 
604 and 614, also may be displayed to the user through user interface 606. 



• 
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An illustration of such correction will now be described in connection with Fig. 
7. Images 700 and 702 are the original input images. Rectangle 704 moves to the right 
from a position in the first image to a new position in the second image, as indicated at 
706. Circle 705 moves down from a position in the first image to a new position in the 
5 second image, as indicated at 707. Image 708 illustrates nonzero motion vectors 710 that 
are computed based on the two images 700 and 702. It should be understood that these 
images are provided for the purpose of illustration only and do not represent actual 
examples. A result of applying the motion vectors 710 to warp the original image, the 
image 712 is obtained. However, the circle 705 is moved incorrectly to the position at 

10 711. Using the technique shown in Fig. 6, a user specifies objects 714 and 716 in images 
718 and 720 as corresponding, and the user defines a region of influence 722. Because 
object 714 moves down to object 716 within the region of influence 722, new motion 
vectors are created based on a transform between objects 714 and 716. When these 
vectors are combined with the originally estimated motion vectors 710, the result is 

15 shown at 724 in image 726 as the changed vectors. When these changed vectors are 
applied to the input image to warp the image to generate the output image, correct 
motion is obtained, as indicated by image 728. 

An alternative approach that also uses user-specified transforms involves coarsely 
aligning objects using a user-specified transform to warp the input images, using 

20 conventional warping techniques. Motion estimation is then applied to the warped 
images. The warped images then may be processed using the estimated motion to 
perform a fine alignment of the objects. Motion between the images that are generated by 
such a warp operation can then be estimated, and used to more finely align the two 
objects. This process is illustrated in Fig. 8. Input images 800 and 802 are input to a 

25 conventional warp engine 804. A user interface is used to obtain user input 806 that 
specifies the warp operation to be performed. The warp operation so performed 
generates warped output images 808 and 810. Processing with motion estimation is then 
performed as indicated at 812. In particular, motion estimation is performed on the 
images 808 and 810, to produce motion vectors that are used to warp and blend the 

30 images 808 and 810 to produce the final morphed output image 814. 

Having now described a few embodiments, it should be apparent to those skilled 
in the art that the foregoing is merely illustrative and not limiting, having been presented 
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by way of example only. Numerous modifications and other embodiments are within in 
the scope of one of ordinary skill in the art and are contemplated as falling within with 
scope of the invention. 

What is claimed is: 



